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(54) Method of and apparatus for video bitstream transmission over packet networks 



(57) Apparatus and method of transmitting a video 
bitstream from a transmitter over a facility to a receiver, 
the video bitstream including a plurality of high priority 
segments and associated low priority segments, is dis- 
closed. The transmitter first transmits high priority infor- 
mation (133), representative of the high priority 
segments, of the video bitstream over the facility using a 
first packet delivery mechanism having a first probability 
of success and subsequently transmits a low priority par- 
tition (137), including the low priority segments, of the 
video bitstream over the facility using a second packet 
delivery mechanism having a second probability of suc- 
cess which is substantially lower than that of the first 
delivery mechanism. At the receiver, the high priority par- 
tition is received and used to generate the high priority 
segments. When each low priority segment of the low 
priority partition is received, the associated high priority 
segment is interleaved in real time with the received low 
priority segment to create an interleaved video bitstream. 
The high priority information may be sent as a high pri- 
ority partition (including the high priority segments), sent 
as a high priority format (used by the receiver to generate 
high priority segments), or sent as a high priority identi- 
fier (used to identify previously stored high priority seg- 
ments at the receiver). 
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Description 
Technical Reld 

This invention relates to video transmission and. 
more particularly, to a technique for transmitting com- 
pressed previously stored video over lossy packet net- 
works in real time so as to reduce the effects of packet 
losses on the quality of the received video. 

PacKqround of the Invention 

Transmission of stored compressed video over lossy 
packet networks has a number of important applications 
including movies-on-demand, interactive television, and 
corporate educational video distribution. Most of the 
present and planned packet networks, particularly Asyn- 
chronous Transfer Mode (ATM) networks, exhibit packet 
loss. Since compression reduces redundancy in the 
video signal, losing random parts of a compressed video 
bit-stream may cause drastic reduction in the quality of 
the received video. It is a continuing problem to improve 
the quality of video transmission over such packet net- 
works. 

Summary of the Invention 

The present invention discloses apparatus and 
method of transmitting a video bitstream from a transmit- 
ter over a packet network to a receiver, the video bit- 
stream including a plurality of high priority segments 
(high priority partition) and low priority segments (low pri- 
ority partition). The high priority segments contain vital 
control information such as the codes that define the 
start of pictures and picture header information. The low 
priority segments contain the rest of the bitstream. As an 
example, the high priority and low priority segments may 
be determined in accordance with the well-known 
MPEG-2 draft standard (see Generic Coding of Moving 
Pictures and Associated Audio. Recommendation 
H.262, ISO/IEC 13818-2, March 1994). In the present 
Invention, high priority information, representative of the 
high priority segments, Is sent first over the network 
using a guaranteed delivery mechanism of the network; 
thereafter the low priority partition is sent in real time over 
the network using a non-guaranteed delivery mecha- 
nism. At a receiver location, the high priority information 
is received and used to generate the high priority seg- 
ments. When the low priority partition is received at the 
receiver location, its segments are interleaved with each 
generated high priority segment in real time to recreate 
the video bitstream. 

The high priority information may be sent as a high 
priority partition, sent as a high priority format used by 
the receiver to generate a high priority partition, or sent 
as a high priority identifier used to identify a high priority 
partition previously stored at the receiver. 



Brief Description of the Drawings 

FIG. 1 shows our inventive method for the transmis- 
sion of high and low priority segments; 
FIG. 2 shows an illustrative client server video dis- 
tribution network useful in understanding the 
present invention; 

FIG. 3 shows various formats for storing video bit- 
streams in a disc at the server location; 
FIG. 4 is a flowchart desaibing the server and client 
interactions for handling video segment requests; 
FIG. 5 shows Table 7-28 of the MPEG-2 draft stand- 
ard illustrating priority break points; and 
FIG. 6 shows examples of high priority formats. 

□ e tgil e^ D g scri p tipn 

With reference to FIG. 1. we describe how the 
present invention is used for the transmitting of high and 
low priority portions of video information over a packet 
network. Analog video signals associated with each 
video program (or video segment) are received in the 
standard NTSC, PAL, etc.. formats, digitized in digitizer 
105, compressed in compressor 110 and the resulting 
compressed video bitstream is stored in a disc 1 1 5. Illus- 
tratively, the well-known format of a video bitstream of a 
video segment is shown by 120. As shown, the illustra- 
tive video bitstream data for a video segment includes a 
plurality of high priority (e.g., HP1) and low priority (e.g., 
LP1) segments. In an encoded bitstream, the partition 
boundaries (e.g., that between HP1 and LP1) cannot be 
determined without some processing. This *'data parti- 
tioning" is described in the above-identified MPEG-2 
standard as a technique that splits a video bitstream into 
two layers called partitions. A priority breakpoint indi- 
cates which syntax elements are placed in partition 0. 
which is the t^ase partition (also called high priority par- 
tition). The remainder of the bitstream is placed in parti- 
tion 1 (which is also called low priority partition). The 
interpretation of •'prio''ity_breakpo!nt" is given in Table 7- 
28 on page 1 1 3 of the MPEG-2 standard, which is repro- 
duced herein as FIG. 5. 

In the prior art, when a request for a video segment 
is received, tiie video bitstream 120 is obtained from stor- 
age 1 1 5 and processed by a priority transmitter unit (not 
shown in FIG. 1) so that the high priority partition (e.g., 
segments HP1 - HPn) is sent over a high priority channel 
of a transmission facility and the low priority partition 
(e.g., segments LP1 - LPn) is sent over a low priority 
channel of the facility In such an anangement, tiie high 
priority channel is typically one having a high probability 
of delivery, while the low priority channel is one having a 
substantially lower probability of delivery Undesirably, 
facilities which connect to a packet network may only 
have channels which operate at one error rate. In such 
an arrangement, tiie prior art techniques may not be as 
useful. 

In accordance with the present invention, server 
processor 130 determines if the high priority information 
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sent to the clients should be sent using the high priority 
segments themselves (steps 1 32, 1 33). sent using a high 
priority format (steps 132, 134, 1 35), or sent using a high 
priority identifier (steps 132, 134, 136) which Identifies a 
previously stored high priority partition at the client or 
receiver location. In one example, when the high priority 
information is to be sent as the high priority segments 
themselves (step 133), server processor 130 of the 
stored bitstream 1 1 5 generates the high priority partition 
(311 of FIG. 3) and the low priority partition (312 of FIG. 
3). In such a case, the server sends the high priority par- 
tition followed by the low priority partition segments (step 
137) to the client location. As noted, tiie server may also 
send the high priority Information In the form of a high 
priority format (step 135, see FIG. 6) or a high priority 
identifier (step 136) followed by the low priority partition 
(step 137) to the client location. 

With reference to FIG. 2, we describe an illustrative 
sender/client network in which the present invention may 
be utilized. Such a network includes a server location 
200 which connects via packet network 210 to a plurality 
of clients 220-230. Server location 200 includes a video- 
on-demand server/processor 201 which controls the 
operation of the hard disc 202 and network interface 203. 
The hard disc 202 is used to store the compressed video 
bitst^eams utilizing one or more of the formats shown in 
FIG. 3. It should be noted that all of the compressed 
video data stream need not be stored locally on disc 202, 
but may be remotely stored, as part of a remote file 
server, and accessible via facility 204 (e.g.. a local area 
network). 

The network interface 203 is utilized to transmit and 
receive using tiie protocols required by the packet net- 
work 210. The processor 201 performs the functions 
illustrated at tiie server portion of the flowchart of FIG. 4. 

The packet network 210 may be an Asynchronous 
Transfer Mode (ATM) network, an FDD I. an Ethernet or 
other similar packet networks. 

A client location, e.g., 220. includes a network inter- 
face 223 for converting communication protocols 
received from and transmitted over a facility connected 
to packet network 210. A disc 222 is used to store the 
high priority portion of the video bitstream received by 
network interlace 223. The video client processor 221 
processes the received video bitstream in accordance 
withtiie client functions illustrated in the flowchart of FIG. 
4. Processor 221 interleaves the high priority data 
received from disc 222 witii the low priority data received 
by network interface 223 and tiien sends the interleaved 
data to decoder 224. The output of decoder 224 is the 
requested video segment which is then displayed on the 
client nronitor 225. 

Similarly, client 230 includes processor 231, disc 
232, network interface 233, decoder 234 and monitor 
235. 

Witii reference to FIG. 3, we desaibe ttie various 
formats for storing video bitsf earns representing data of 
video segments 1 through n. 



Shown by 310 is the raw compressed data stream 
for video segments 1 - n, where the high priority and low 
priority portions are HP1 - HPn and LP1 - LPn, respec- 
tively In the raw compressed data stream, tine separation 

5 between tiie high priority (e.g., HP1) and low priority 
(e.g.. LP1) data portion can be defined based on priority 
breakpoints. These priority breakpoints can have a vari- 
ety of values as shown in FIG. 5 which illustrates Table 
7-28 of tiie previously referenced MPEG-2 standard. In 

10 accordance with the present invention, the network 
server can be arranged to handle any of the breakpoint 
values shown in Table 7-28 (FIG. 5). When data is stored 
as a raw compressed data stream, the network server 
200 must first identify the video segment requested by a 

75 client and tiien process the data stream associated witii 
tiiat requested segment using tiie particular breakpoint 
value to identify the high priority data segments. It shoukJ 
be noted that the division between tiie high priority and 
low priority partitions varies witii the particular video seg- 

20 ment and the type of priority breakpoint (see Table 7-28 
of FIG. 5) utilized for partitioning. Illustratively, in one 
emtxxliment the high priority data portion HP1 includes 
tiiose data items of priority breakpoint 1 shown in Table 
7-28 of FIG. 5. 

25 Generally, any of tiie priority breakpoints of FIG. 5 
can be sent as part of tiie high priority partition (133 of 
FIG. 1). However, only priority breakpoints 0-1 would be 
used if a high priority format (135 of FIG. 1) or high pri- 
ority identifier (136 of FIG. 1) is used as the high priority 

30 information sent to the client. 

Hence, witii reference to FIG. 3, HP1 would include 
sequence start, GOP and picture header 1. The picture 
header also includes a time or frame identifier. The 
sequence start header includes data defining the vertical 

35 and horizontal resolution of tiie video segment. A video 
segment includes multiple pictures (or frames). The pic- 
ture (or frame) rate may be from 24 per second for motion 
pictures to 30 per second for broadcast television. Each 
picture (or frame) may include a plurality of slices. The 

4G GOP data Is optional, and includes the picture coding 
utilized for the segment. The picture header 1 includes 
tiie header information for all slices of picture 1 (or frame 
1). The low priority data portion l_P1 includes tiie rest of 
tiie bitstream for picture 1. Additionally in accordance 

45 wrth the present invention, the low priority data portion 
LP1 may include time and frame identifiers con-espond- 
ing tothatof HP1. Similarly, each of the high priority data 
portions HP2 through HPn include at least tiie headers 
for the slices of the associated picture. The length of 

50 each video segment may be different and have a different 
number of high priority arxJ low priority data portions 
within each segment. Note that the size of the low priority 
data portions LP1 - LPn may be diff^ent lengths due to 
picture content. 

55 After identifying these high priority data portions 
HP1 - HPn, network server 200 then forms tiie high pri- 
ority and low priority data segments shown, respectively 
by 31 1 and 312. Shown by 320. the data for video seg- 
ment 1 has been processed into a high priority data par- 



3 



3 



EP0701 376 A2 



4 



tition 31 1 and a low priority data partition 312 and stored 
on disc 202. This processing of the data may be done by 
server 200 or the data may be received in processed 
form by server 200 and downloaded to disc 202. Simi- 
larly, the data associated with video segments 2 through 
n have also been stored after having been partitioned 
into high priority and low priority data portions. When the 
data or video segments 1 - n are stored using the format 
320, then the network server 200 need only transmit the 
high and low priority partitions of the requested segment 
to the client without further processing. Thereafter, the 
server 200 outputs the requested video segment to the 
client in the format shown by 320. 

Shown in 330 is another format for storing video seg- 
ment bitstreams. This format uses the raw conrpressed 
data streams of 31 0 together with a table 338 which pref- 
erably identifies the disc location and time stamp or 
frame identification for each high priority data portion of 
each video segment. Alternatively, the length of the high 
and low priority data portions or perhaps a time stamp 
or frame identification for each high priority data portion 
may also be stored in the table 338. Using the fbmiat 
shown in 330, server 200 can quickly form the high pri- 
ority data segment 311 and low priority segment 312 
using the table entries to quickly locate the high priority 
data portions HP1 - HPn stored on disc 202. Conse- 
quently, server 200 can process a requested video seg- 
ment by a client in real time and output a data stream of 
the requested video segment to the client in the fornnat 
shown by 310. 

Alternatively, server 200 can send high priority infor- 
mation using high priority format 340 or high priority iden- 
tifier 341 . This high priority information is used by the 
receiver to generate a high priority partition - - that is. in 
our example shown in Table 338, either an international 
standard, if one exists, or a format previously agreed-to 
by the client and server 200. 

Another implementation may use a high priority 
identifier to identify which of se^^erai previously stored 
high priority partitions available at the client receiver is 
to be interleaved witti the low priority partition to recon- 
struct tiie original video bitstream. In such an embodi- 
ment, tiie high priority information sent to the client would 
include either the appropriate high priority format or iden- 
tifier information. 

With reference to FIG. 6, we illusfrate an example of 
a high priority standard format which may be sent from 
the server 200 to the client. As shown by 601 , tiie format 
includes an M and N number and MPEG2 picture level 
information. As shown, the MPEG2 picture level informa- 
tion includes an I and, optionally, a P and/or B frame. As 
shown, tiie M specifies tiie number of 6 frames between 
P or I frames + 1 and N specifies the number of B or P 
frames between I frames + 1 , where I is the intra-coded 
frame, B is the bidirectional coded frame, and P is the 
predictive coded frame. Shown in 602 are several exam- 
ples of different M and N values for high priority formats 
1.2 and 3. 



With joint reference to FIGS. 2, 3, and the flowchart 
of FIG. 4, we describe tiie server and client interaction 
for handling video segment requests from a client. 
In step 400, server 200 is in a wait state, waiting for 

5 a client request. In step 401 , a client 220 requests a par- 
ticular video segment. In step 402, network server 200 
receives a client's video segment request. In step 403, 
server 200 reads the high priority data, reads tiie high 
priority format or reads tiie high priority identifier for tiie 

10 entire requested segment. Thus, for example, if the data 
for a video segment was stored in the format 320. tiien 
server 200 need only read out tiie high priority data seg- 
ment 311 from disc 202. However, as previously 
described, if data for the requested video segment was 

15 stored, or received from a remote file server, in its raw 
compressed data form, server 200 must process that 
data to aeate tiie high priority data segment 31 1 from 
the individual high priority data items HP1 tiirough HPn 
of 310 of FIG. 3. Even ttiough a video segment is 

20 received in its raw compressed data form, it may still be 
sent to the client in real time. For example, tiie desired 
video segment may be broken into multiple sub-seg- 
ments, each witii its own high priority 31 1 and low priority 
312 partitions. Server 200 may tfien provide an elastic 

25 first-in-first-out buffer {p/o processor 201 ) to store at least 
one sub-segment. The transmission of the first sub-seg- 
ment is delayed by at least one sub-segment's time 
period, so that server 200 can set up the HP partition 
311 and LP partition 312 for the first sub-segment. 

30 Thereafter, while the first sub-segment is being ti-ansmit- 
ted to the client, the next sub-segment is being received 
and processed by server 200. In this manner, the HP and 
LP partitions 31 1 and 3 1 2 can be formed and transmitted 
to tiie client in real time from tiie received raw com- 

35 pressed data stream. 

Alternatively, if data for tiie requested video segment 
was previously stored in disc 202 in the format 330, then 
server 200 would utilize table 338 to identify in real time 
tiie high priority data partition in the data stream of tiie 

40 requested video segment. Using eitiier 1 ) the high prior- 
ity data of the requested video partition 3 1 1 stored in disc 
202, or 2) tiie processed raw compressed data stream 
which is formatted into the high priority data partition 31 1 
or 3) by using table 338 together with tiie raw com- 

45 pressed data stream to generate the high priority data 
partition 31 1 in real time, server 200 prepares the high 
priority data for the requested video segment for trans- 
mission to the requesting client. Alternatively, as previ- 
ously noted tiie server 200 can send information in the 

so form of the high priority data itself, high priority format 
information, or a high priority identifier, depending on the 
implementation of tiie client/server network. In step 404. 
server 200 selects a packet network 210 communication 
protocol which ensures guaranteed delivery of tiie high 

55 priority information over the packet network 210 to the 
requesting client. Tiie communication protocol for guar- 
anteed delivery would, of course, be one that is specified 
by packet network 210. Such communication protocols 
for guaranteed delivery are well known in the art. For 
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example, see "Reliable Stream Transport Service 
(TCP)." Chapter 12 of the book by D. E. Comer errtltled 
Internetworking with TCP/IR Volume 1 : Principles. Pro- 
tocols and Architecture. Second Edition, Prentice Hall, 
1 991 . Typically, such a communication protocol for guar- 
anteed delivery involves the sending of data packets with 
error detection and, possibly, error correction capability 
to the client. The client would then, typically, after receiv- 
ing the packet send an acknowledgment message back 
to the sen/er 200. This acknowledgment message would 
indicate to server 200 whether client 220 has received 
the packet with errors or en'or-free. This acknowledg- 
ment message can also be used to alert the server 200 
when an out-of -sequence data packet has been received 
by client 220. If no acknowledgment message is received 
by server 200 within a predetermined time, server 200 
would re-send the data packet. 

In step 405. client 220 sets Itself to receive using the 
communication protocol for guaranteed reception and 
signals the server 200 that It is ready to receive data 
packets. In step 406, server 200 sends all of the high 
priority data to client 220. In step 407, for our example, 
the client receives the high priority data. The previously 
described communication protocol for guaranteed deliv- 
ery ensures that the client 220 has received the high pri- 
ority data error-free from the server 200. In step 408. 
client 220 stores the high priority data. Note, because 
the HP partition (HP1 - HPn) generally represents 
approximately 0.2 percent of all of the data for a selected 
video segment, it can easily be stored on the disc (e.g., 
222) at the client location. In comparison, the LP partition 
(LP1 - LPn) for a typical movie video segment would be 
too large (typically several gigabytes) to be practical for 
storage at the client location. Because of the low-cost 
wideband transmission network 210 available, the LP 
partition can be readily retransmitted any time that the 
client wants it. 

If tiie high priority information was in the form of a 
high priority format or identifier, then In steps 407 and 
408 they would be received and stored. Alternatively, In 
step 408 the high priority format may be utilized to gen- 
erate the high priority partition information which would 
then be stored. 

In step 409, the server 200 sets the communication 
protocol for non-guaranteed delivery of the low priority 
data of the requested video segment to the client 220. In 
accordance with an aspect of the present invention, the 
system can limit tiie number of times that the low priority 
data of the requested video segment can be sent to the 
client 220. This ability to multiply send the low priority 
partition 312 to the client 220 enables the client to have 
a capability to pause or rewind during tiie reception of a 
video segment without having to again receive the high 
priority partition 31 1 . 

In step 410, client 220 sets a communication proto- 
col for the non-guaranteed reception of tiie low priority 
partition. The client 220 knows to set the non-guaranteed 
protocol when It receives an end-of-high-priority flag as 
part of the high priority data reception during step 407. 



In step 41 1 , server 200 reads from disc 202 the low 
priority data partition 312, when format 320 is utilized (or 
creates the low priority data partition 312 when format 
310 or 330 is utilized, as previously described). In step 

5 412, server 200 transmits tiie low priority data partition 
312 in real time to client 220. The packets containing the 
LP data may include frame numbers, time stamps, 
sequence numbers enabling resynchronization to the 
associated HP data at tiie client decoder 224 in tiie case 

10 of LP packet loss. 

In step 413, in our exanple. client 220 reads the high 
priority partition from menfx>ry and, in step 414, sends it 
to video decoder 224. Alternati'vely, if a high priority iden- 
tifier was stored in step 408, It would be used to access 

15 the high priority partition at the client location. If, how- 
ever, the high priority format information was stored In 
step 408, then In step 413 it could be used to generate 
the high priority partition. 

In step 415, client 220 receives the low priority data 

20 segment in real time from server 200 and sends it in step 
416 to video decoder 224. The steps 414 and 416 are 
coordinated by processor 221 so that the stored high pri- 
ority partition Is Interleaved in real time with tiie received 
low priority partition sent to video decoder 224. The Inter- 
ns leaved data would have tiie original raw compressed 
data stream format shown by 310. Video decoder 224 
then converts the interieaved data to the display format 
needed to enable monitor 225 to display the requested 
video segment. 

30 In step 417. client 220 can request to replay the 
video segment. If a control command request is made, 
in step 418. control returns to step 41 1. A control com- 
mand request may be tiie well-known VCR-type request 
including stop, pause, fast forward, fast backward, replay. 

35 etc. The stop command instructs the server 200 to not 
send any additional low priority data. The pause com- 
mand performs the stop command function but addition- 
ally causes decoder 224 to hold the last frame. The fast 
fonvard command causes server 200 to send only 

40 MPEG-2 I frames of the low priority partition. The fast 
backward command causes the sender 200 to send the 
I frames in reverse order The replay command causes 
server 200 to re-send only the low priority partition. 
These capabilities may Illustratively be Implemented 

45 consistent with the Trick modes" described In section 
D.12 at page 167 of the previously referenced MPEG-2 
draft standard. 

If tiie cont'd command requests a new video seg- 
ment, step 419. control returns to step 402. If no control 

50 command request is made, step 420. then processor 221 
clears the previously stored high priority data from mem- 
ory. In step 421 the procedure ends and control returns 
to the standby state, step 400. 

While the present invention has been described for 

55 an encoded video bitstream. It can more generally be 
used with unencoded video bitstireams. 

What has been described is merely illusti-ative of the 
application of the principles of tiie present Invention. 
Other an-angements and methods can be implemented 
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by those skilied in the art without departing from the spirit 
and scope of the present invention. 

Claims 

1. A method of transmitting a video bitstream from a 
transmitter over a facility to a receiver, the video bit- 
stream Including a plurality of high priority segments 
and associated low priority segments, said method 
CHARACTERIZED BY the steps of 

at the transmitter, 

first transmitting a high priority partition (133), 
including the high priority segments, of the video bit- 
stream over the facility using a first packet delivery 
mechanism having a first probability of success; 

subsequently transmitting, after the comple- 
tion of transmission of the high priority partition, a 
low priority partition (137). including the low priority 
segments, of the video bitstream over the facility In 
real time using second packet delivery mechanism 
having a second probability of success which is sub- 
stantially lower than that of the first delivery mecha- 
nism; and 

at the receiver. 

receiving and storing (407, 408) the high pri- 
ority partition; 

receiving the low priority partition (415); and 
interleaving (41 6) each high priority segment, 
obtained from storage, in real time with the associ- 
ated received low priority segment to create an inter- 
leaved video bitstream. 

2. A method of transmitting a video bitstream from a 
transmitter over a facility to a receiver, the video bit- 
stream including a plurality of high priority segments 
and associated low priority segments, said method 
CHARACTERIZED BY the steps of 

at the transmitter, 

first transmitting high priority information 
(133), representative of the high priority segments, 
over the facility using a first packet delivery mecha- 
nism having a first probability of success; 

subsequently transmitting, after the comple- 
tion of transmission of the high priority Information, 
a low priority partition (1 37). including the low priority 
segments, of the video bitstream over the facility in 
real time using a second packet delivery mechanism 
having a second probability of success which is sub- 
stantially lower than that of the first delivery mecha- 
nism; and 

at the receiver. 

receiving the high priority information (407) 
and using it to generate the high priority segments; 
receiving the low priority partition (415); and 
interleaving (41 6) each generated high prior- 
ity segment in real time with the associated received 
low priority segment to create an Interleaved video 
bitstream. 



3, The method of claim 2 further CHARACTERIZED 
BY the steps of 

at the transmitter. 

receiving a video bitstream having high prlor- 
5 ity segments interleaved with associated low priority 
segments; 

storing the video bitstream; 

generating a table identifying the assodation 
between high priority segments and low priority seg- 
10 ments in the video bitstream; and 

creating the high priority partition using the 
table to access the high priority segments from the 
stored video bitstream prior to said first transmitting 
step. 

15 

4, The method of claim 2 further CHARACTERIZED 
BY the steps of 

at the receiver. 

requesting a delivery of a bitstream of an 
20 identified video segment; and 
at the transmitter, 

receiving the video segment request and in 
response thereto accessing the bitstream for the 
identified video segment prior to the transmitting 
25 step. 

5. The method of claim 2 further CHARACTERIZED 
BY the steps of 

at the receiver. 

30 sending a control command request to the 

transmitter; and 

at the transmitter. 

decoding and controlling the transmission of 
said low priority partition to the receiver in response 
35 to a received control command request. 

6. The method of claim 2 further CHARACTERIZED 
BY the steps of 

at the receiver, sending a replay command to 
40 the transmitter requesting a replay transmission of 
the low priority partition; 

at the transmitter, in response to the replay 
command, sending a replay transmission of the low 
priority partition to the receiver; and 
45 at the receiver, interleaving in real time a high 

priority segment associated with each received low 
priority segment of the replay transmission received 
from the transmitter. 

50 7. The method of claim 2 CHARACTERIZED IN THAT 
the high priority information includes stand- 
ard format information used by a receiver to gener- 
ate the high priority segments. 

55 8. The method of claim 2 CHARACTERIZED IN THAT 
tiie high priority information is used to identify 
high priority segments previously stored at the 
receiver. 
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9. Apparatus for transmitting a video bitstream from a 
transmitter over a facility to a receiver, the video bit- 
stream including a plurality of high priority segments 
and associated low priority segments, said appara- 
tus CHARACTERIZED BY 5 

at the transmitter, 

first means for transmitting a high priority par- 
tition, including the high priority segments, of the 
video bitstream over the facility using a first packet 
delivery mechanism having a first probability of sue- 10 
cess; 

second means for transmitting, after the com- 
pletion of transmission of the high priority partition, 
a low priority partition, including the low priority seg- 
ments, of the video bitstream over the facility in real 15 
time using a second packet delivery mechanism 
having a second probability of success which is sub- 
stantially lower than that of the first delivery mecha- 
nism; and 

at the receiver, 20 
means for receiving the high priority and low 
priority partitions; 

means for storing the high priority partition; 

and 

means for irrterleaving a high priority seg- 25 
ment, obtained from storage, in real time with the 
associated low priority segment to create an inter- 
leaved video bitstream. 

10. Apparatus for transmitting a video bitstream over a 30 
facility to a receiver, the video bitstream including a 
plurality of high priority segments arKl associated 
low priaity segments, said apparatus CHARAC- 
TERIZED BY 

first means for transmitting a high priority par- 35 
tition, including the high priority segments, of the 
video bitstream, over the facility using a first packet 
delivery mechanism having a first probability of suc- 
cess; and 

second means for transmitting, after the com- 40 
pletion of transmission of the high priority partition, 
a low priority partition, including the low priority seg- 
ments, of the video bitstream over the fadlity in real 
time using a second packet delivery mechanism 
having a second probability of success which Is sub- 45 
stantially lower than that of the first delivery mecha- 
nism. 

11. Apparatus for receiving a video bitstream over a 
facility from a transmitter, the video bitstream includ- so 
ing a plurality of high priority segments and associ- 
ated low priority segments, said apparatus 
CHARACTERIZED BY 

means for first receiving the high priority par- 
tition and, after the completed reception of the high 55 
priority partition, receiving the low priority partition; 

means for storing the high priority partition; 

and 

means for interleaving a high priority seg- 



ment, obtained from storage, in real time with the 
associated low priority segment to create an inter- 
leaved video bitstream. 

12. Apparatus for fransmitting a video bitstream from a 
transmitter over a facility to a receiver, the video bit- 
stream including a plurality of high priority segments 
and associated low priority segments, said appara- 
tus CHARACTERIZED BY 

at the transmitter, 

first means for transmitting high priority infor- 
mation, representative of the high priority segments, 
over tiie facility using a first packet delivery mecha- 
nism having a first probability of success; 

second means for transmitting, after the com- 
pletion of transmission of the high priority informa- 
tion, a low priority partition. Including the low priority 
segments, of the video bitstream over the facility in 
real time using a second packet delivery mechanism 
having a second probability of success which Is sub- 
stantially lower than that of the first delivery mecha- 
nism; and 

at the receiver. 

means for receiving the high priority informa- 
tion and using It to generate tiie high priority seg- 
ments; 

means for receiving the low priority partition; 

and 

means for Interleaving each generated high 
priority segment In real time with tiie associated 
received low priority segment to create an inter- 
leaved video bitstream. 

13. Apparatus for transmitting a video bitsf earn over a 
facility to a receiver, the video bitstream including a 
plurality of high priority segments and associated 
low priority segments, said apparatus CHARAC- 
TERIZED BY 

first means for transmitting high priority infor- 
mation, representative of the high priority segments, 
over the facility using a first packet delivery mecha- 
nism having a first probability of success, the high 
priority information being used to generate the high 
priority segments at the receiver; and 

second means for transmitting, after the com- 
pletion of transmission of the high priority Informa- 
tion, a low priority partition. Including the low priority 
segments, of tiie video bitstream over the facility in 
real time using a second packet delivery mechanism 
having a second probability of success which is sut>- 
stantially lower than tiiat of the first delivery mecha- 
nism. 

14. Apparatus for receiving a video bitstream over a 
facility from a fransmitter, the video bitstream includ- 
ing a plurality of high priority segments and associ- 
ated low priority segments, said apparatus 
CHARACTERIZED BY 

means for receiving the high priority informa- 
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tion and using it to generate the high priority seg- 
ments; 

means for receiving, after the completion of 
reception of ttie high priority information, the low pri- 
ority segments; and 5 

means for interleaving each generated high 
priority segment in real time witii the associated low 
priority segment to create an interleaved video bit- 
stream. 
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The numbers of the following references are cited in this Office Action for the first time and 
will be used consecutively throughout the examination proceedings: 

(1) JP 11-146224 A 

(2) : = JP 11-146224 A English translation. PAJ [online], [found on February 23, 2005] on 

the Internet < URL* htlD://www4.iDdl.nciDl.Qo.iD > 

(3) EP701376A2 

With the aid of the English translation (2). the following features can be gathered from ref- 
erence (1), in particular from Rg. 3 + 4: 

- segmenting each data set into a plurality of segments a-e ([0012]/-S2-), 

- assigning a transmission precedence (priority) to each of the segments (divided 
field) according to the data set ([0012J/-S3-) from which it was segmented [001 1], 
and 

- transmitting the segments in order of the assigned precedence ([00121/-S4-). 
The person skilled in the art will read into the disclosed fundamental application of a digital 
camera in (1). [0002] and into the problem of downloading image information [0003] that 
individual images or a plurality of images are downloaded. This will, however, lead the per- 
son skilled in the art to the residual feature of claim 1 , when he makes use of the method 
according to reference (1). In view of the fact that no transmission takes place for e.g. sev- 
eral images between the asynchronous downloading according to (1), Fig. 3a, the otheowse 
"empty" transmission time between the respective high-priority data segments e can be 
supplemented by the transmission with low-priority data segments a-d, as can already be 
seen from Fig. 3a. This consideration is also confirmed by paragraph [0023] according to 
which it is attempted to transmit ail segments; however, the segments transmitted may per- 
haps only be high-priority segments, i.e. a transmission of low-priority segments will not 
always take place. 
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It follows that the method according to claim 1 is apparently not even new. Claim 1 is pre- 
sumably not allowable. 

The device claims 5 and 9. which concern similar features, have to be judged in the same 
way. 

The applicant's attention is also drawn to reference (3) which is also opposed to the grant of 
a patent and which divides image infomnation (title) into segments (HPl-HPn. LP1-LPn) and 
transmits the respective high priority HPh before the low priority LPn. the lower priority. e.g. 
LP1, being inserted between segments HP1, HP2 having a higher priority. Depending on 
the image information quantity, the person skilled in the art can also in this case read into 
said reference (3) that, in connection with a more than sufficient transmission bit rate, a cer- 
tain time gap will be necessary between the high-priority data segments. 

The assigning of a priority to data sets according to claims 2. 6 and 10 can. however, also 
be inferred from (1), [0011], on the basis of the priority assignment for the central image 
data set 

The segmenting by means of IP according to claims 3. 7 and 1 1 does not exceed the 
knowledge of those skilled in the art. since the person skilled in the art will be able to im- 
plement the transmission technique of the methods accorxiing to (1) or (3) in accortance 
with the existing networit protocols. In reference (2). column lyiine 38. packet networi<s are 
even mentioned: IP is known to the person skilled in the art as one of the most frequently 
used protocols (Internet). 

The use of image data sets according to claims 4. 8 and 12 is known in detail from refer- 
ence (1). Fig. 12 or Fig. 8 or Fig. 3B or Fig. 1 1 or Fig. 128 in combination with the relevant 
text passages. Also in the case of video applications according to (2). Abstract, image in- 
formation is inevitably transmitted. 
Grant of a patent cannot be expected. 
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